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Abstract 

We consider conservative quantum evolutions possibly interrupted by macroscopic 
measurements. When started in a nonequilibrium state, the resulting path-space 
measure is not time-reversal invariant and the weight of time-reversal breaking 
equals the exponential of the entropy production. The mean entropy production 
can then be expressed via a relative entropy on the level of histories. This gives a 
partial extension of the result for classical systems, that the entropy production is 
given by the source term of time-reversal breaking in the path-space measure. 
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1 Quantum entropy 



In bridging the gap between classical mechanics and thermal phenomena, the 
founding fathers of statistical mechanics realized that a statistical characteri- 
zation of macrostates in terms of microstates is essential for understanding the 
typical time evolution of thermodynamic systems. But statistical reasoning re- 
quires proper counting, starting from a set of a priori equivalent microstates. 
That is different in quantum statistics from what is done in classical statistics. 
Nevertheless the same concepts can be put in place. In this paper, we show 
for the quantum case what has been proven useful in the classical case: that 
entropy production measures the breaking of time-reversal invariance. More 
exactly, we show that the logarithmic ratio of the probability of a trajectory 
and its time-reversal coincides with the physical entropy production. 
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We continue with an introduction about entropy, both classical and quantum, 
to specify what we mean by entropy production. The main message is con- 
tained in Sections 2 and 3 where the relation between entropy production and 
time-reversal is demonstrated. Section 2 deals with a unitary evolution (one 
initial preparation and one final measurement) and can be considered as a spe- 
cial case of Section 3 where the unitary evolution is further interrupted with 
measurements of the macrostate. The paper is based on elementary mathe- 
matical manipulations and the emphasis is on the conceptual framework. 



1.1 Classical set-up 



Suppose a classical closed and isolated system of N particles. A complete de- 
scription consists in specifying its microstate, that is a point x in its phase 
space, x = (q±, . . . , (?jv,Pi, • • • ,Pn) of positions and momenta. The dynam- 
ics is Hamiltonian and energy is conserved. Each microstate x determines a 
macrostate M(x) corresponding to a much coarser division of phase space. To 
be specific, we consider the surface V of constant energy and we suppose that 
the macrostates induce a finite partition T of T. The different macroscopic 
values thus specify a (finite) number of regions in phase space. We emphasize 
that this reduced description is in terms of macroscopic variables (in contrast 
with the partitions as used e.g in constructions of dynamical entropies), such 
as position or velocity profiles and we denote by \M\ the corresponding phase 
space volume. 

The Boltzmann entropy (also called Boltzmann-Planck-Einstein or micro- 
canonical or configurational entropy) is, up to multiplicative and additive 
constants, defined by 

S B (x) = \og\M(x)\ (1.1) 

When the microstate belongs to the region of phase space of unconstrained 
equilibrium, then, at least in the thermodynamic limit, Sb{x) equals the ther- 
modynamic entropy defined operationally by Clausius. But also out of equi- 
librium, say when a constraint is lifted and the system is free to evolve, the 
Boltzmann entropy remains relevant as it will typically increase towards equi- 
librium. It gives in fact the microscopic foundation of the second law of ther- 
modynamics. 

There is another entropy that generalizes (1.1). Suppose we only specify 
a distribution of macrovalues. This means that we do not know the exact 
macrostate, perhaps not even initially. The statistics of macroscopic values 
is then given by a probability distribution v[M\M e T; e.g. our best guess 
about the position and velocity profile. In the absence of any further informa- 
tion, there is a natural probability density, written pj>, on T which gives equal 
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probability to each microstate compatible with a macrostate M: 



M ' \M(x)\ 

The functional 



S G (0) 



- J^dxpi,(x) \np {x) 



is appropriately called Gibbs entropy as it is, since Gibbs, the usual statistical 
mechanical entropy for constrained equilibrium 2 . Put differently, by Gibbs' 
variational principle, 

Sg(v) = sup — / dxp{x)\ap{x) (1.2) 

where the supremum is taken over all phase space densities p with the same 
macro-statistics as u, i.e., the projection p(p) of p on T coincides with v: 

p(M) = J dxp(x) 5(M(x) — M) — v{M) 

and the supremum is reached for p = pp. Equivalently, by a simple calculation, 
the Gibbs entropy equals 

S G (u) = J2 HM) log \M\-J2 v(M) log v{M) (1.3) 

M M 

Obviously, if v concentrates on just one macrostate M, v(M') = 5m,m', then 
£>g(v) — l°g l-^l which is the Boltzmann entropy for that macrostate. More 
generally, the first term in (1.3) is the expected or estimated entropy, being 
unsure as we are about the exact macrostate. The second term in (1.3) is non- 
negative and is most often negligible, certainly upon dividing by the number 
of particles. 

When we start the system from a microstate that is randomly drawn (accord- 
ing to the Liouville measure) from M with probability z>(M) and we record 
the statistics u t on the macrostates after time t, then, always, 

S G {0 t ) > S G (u) (1.4) 

This is not the second law (e.g. it does not imply that Scipt) is non-decreasing 
in t, see [5] for more discussion). To bring it closer to the second law, one needs 
to explain under what conditions Sai^t) approximates the Boltzmann entropy 
SB{xt) with Xt the time-evolved phase point. Looking back at the first term in 
(1.3), that implies understanding how and when the empirical distribution for 



2 Often, even without a specific physical context or meaning, — J r dx n(x) \ogp{x) 
is called the Gibbs entropy of [/,. There is however another name for that functional: 
the Shannon entropy. A way out would be to call Sg(v) the Boltzmann-Gibbs- 
Shannon entropy as in [7] but that sounds overdone. 
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the macrovariables becomes peaked, as the number of particles increases, at a 
fixed macroscopic trajectory as described e.g. by hydrodynamic equations of 
irreversible thermodynamics. 

In [5] we have discussed at length how these entropies relate to time-reversal. 
The main result there was that both for closed systems and for open sys- 
tems, be it in the transient regime or in the steady state regime, the entropy 
production equals the source term of time-reversal breaking in the action func- 
tional for the distribution of the histories (on some thermodynamic scale) of 
the system. This representation gives the entropy production as a function 
of the trajectories and it allows simple manipulations for taking the average 
(to prove that it is positive) and for studying its fluctuations (to understand 
symmetries under time-reversal). In the present paper we begin explaining a 
similar reasoning for finite quantum systems. 

1.2 Quantum set-up 

We take the simplest mathematical set-up for describing a quantum system 
within conventional quantum mechanics. We denote by Ti. the Hilbert space 
of the system, assumed finite dimensional. The system is described in terms of 
a wavefunction ip, or perhaps better, a normalized vector in Ti. The variables 
defining the macrostate are not different from that in the classical situation. 
For example, they specify (again to some appropriate accuracy) the particle 
number and the momentum profiles by associating numbers to a family of 
macroscopically small but microscopically large regions of the volume occupied 
by the system. Therefore, the macrostate is given in terms of the values of 
a set of macroscopic observables represented by commuting operators. The 
macroscopic partition in the classical case above is replaced by the orthogonal 
decomposition 

H = ($H a (1.5) 

into linear subspaces. The macrovariables are represented by the projections 
P a on the respective Ti a , P a P/3 = 5a,pPa, J2 a Pa = id. We write d a for the 
dimension of 7i a ; it is the analogue of the phase space volume \M\ in the 
classical case. We can think of the macrostates as labeled by the running 
index a. For a given macrostate a represented by the projection P a above, we 
stretch the notation of (1.1) and write its Boltzmann entropy as 

S B (a) = log d a = log d(P a ) (1.6) 

So far, the above does not depart essentially from the classical set-up except 
for the important difference that (1.1) is defined on microstates and (1.6) is 
defined on macrostates. At this moment the treatment starts to differ. Fol- 
lowing von Neumann, page 411 in his well-known book [6], as discussed e.g. 
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in [3], the formula (1.1) is changed to 



SnW =S(^^)logda-E(^ p «^) lo g(^^) (1-7) 

a a 

where (tp, P a ip) is the probability of finding the system described via the wave- 
function if; in the macrostate a (values corresponding to T~L a ). Observe that 
(1.7) very much resembles (1.3), eventhough (1.7) is the quantum analogue 
of (1.1), both defined as they are for the microstate. The reason is of course 
quantum mechanics itself: the wavefunction can still correspond to different 
(mutually exclusive) macrostates. If not initially, still later in time, superpo- 
sitions in terms of wavefunctions of different macrostates are possible. This in 
contrast with the classical set-up where a unique macrostate is associated to 
each microstate. Just as the second term in the classical (1.3) arises from addi- 
tional uncertainty as to the exact macrostate, here, even when the microstate 
is given (in terms of ip), we still have a distribution on the macrostates 3 . 

Instead of taking a pure state in (1.7), we may want to consider the system in 
a mixed state and described by a density matrix. In fact, as we are interested 
in the thermodynamic time-evolution, we construct a special class of density 
matrices by specifying the macroscopic statistics just as we did for (1.3). We 
thus start from a probability distribution fx on the possible macrovalues and we 
randomize within. More precisely, we consider density matrices p(jx) defined 
by 

P(A) = E^« (1-8) 
for given jx(a) > 0,J2 a Li(c^) = 1- Then, 

jx(a)=Tr[P a p(jx)} (1.9) 

is the probability to find the system in macrostate a. For the choice fx(a) = 
d a /d where, for normalization, d = J2 a d a is the dimension of Ti, p(fx) = id/d. 
In the other direction, given a general density matrix p, we can take its pro- 
jection p(p) on the macroscopic states: 

p(p)(a)=Tr[P a p] (1.10) 



and of course, p(p(fx)) = fx. 

We now apply the same principle as in 
mann) quantum entropy 



(1.2) to obtain the (Gibbs - von Neu- 



S(p)= sup -Tr[plogp] (1.11) 

p(p)=p, 

3 One of us, CM., likes to emphasize that all this does not exclude that the actual 
system is all the time in exactly one of the macrostates — but the wavefunction 
does not provide a complete description of the system. 
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with solution (reached at p = p(/t)) 

S (P) = J2i j '( a ) lo ^ d »~J2i j '( a )^K a ) (i-i2) 

a a 

which looks exactly like (1.3). Again, S(p) equals Sb(<x) when fi concentrates 
on the macrostate a and, up to some irrelevant constants, S(p) equals the 
relative entropy of p(p) with respect to the equilibrium density matrix id/d. 
More generally, we call 

S(p) = S(p(p)) = Y / Tr[P a p]logd a -]T Tr[P Q p] logTr[P Q p] (1.13) 

a a 

the macroscopic quantum entropy of the (mixed) state p, reducing to (1.12) 
for the choice (1.8) and to (1.7) for a pure state. 



2 Entropy production for a unitary evolution 

The goal of this section is to show that the total change of entropy under a 
quantum conservative evolution, that is the entropy production, can be given 
in terms of a logarithmic ratio of probabilities. 

We suppose a quantum dynamics generated via a real Hamiltonian H. This 
means that the Hamiltonian is time- reversal invariant, Hit = nH where n is an 
anti-linear involution (kinematical time-reversal) which would be just complex 
conjugation for wavef unctions. The unitary evolution U(t) = exp[— itH] where 
t is time (and Planck's constant is set equal to one) then satisfies 

nU(t)7v = u(ty = uity 1 

an expression of dynamic reversibility. We also assume that the macrostates 
are mapped into each other via the involution ir, i.e., 

nP a n = P a , = (2.1) 

for some a', for each a and we write na = a'. 

Let the system be initially prepared with macro-statistics p(p), see (1.8). We 
now leave the system alone, undergoing its quantum evolution. The proba- 
bility to see the system at the initial time in macrostate ao and at time t in 
macrostate a t is given by 

Prob A [a , a t ] = Tr [U(t)P ao p(p,)P ao U(tyP at } (2.2) 
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Its marginal at time t is 

jl t {a) = ]T Prob A [a , a t = a]= Tr [C/(t)p(/i)C/(t)*P a ] (2.3) 



We consider the logarithmic ratio of probabilities 

R- (a a t ) = log Prob AN)> a f] / 2 4 ) 

M °' * Prob At7r [7ro; t , 7To;o] 

where the denominator gives the probability of the time-reversed order of 
measurement results starting from p(ftt^) with /t t 7r(a) = ji t (ira). 

We make two observations. First, when p(a) = d a /d, then also at later times 
fit {a) = d a /d and moreover 

Prob A [a , a t ] = Prob At [ira t , na ] (2.5) 

expressing the time-reversal invariance when started from the time-invariant 
macro-statistics that assigns to macrostates probabilities proportional to the 
exponential of their Boltzmann entropy, see (1.6). 

Secondly, for other choices of the initial macro-statistics, the i? A of (2.4) re- 
produces the change of entropy: 

Rjx(ao,a t ) = hgd at - \ogd ao - log fi t (a t ) + log fi(a ) (2.6) 

where we recognize the change of Boltzmann entropies (1.6) in the first two 
terms. Upon taking the expectation 

53 Prob A [a:o, a t ] Rp,{a G , a t ) = S(fk) - S(ft) (2.7) 

we recover the change in entropy (1.11). Note that S(fit) = S(pt),S(p) = 
S(p) defined in (1.13) for p = p(p), pt = U(t)pU(t)* so that the right-hand 
side of (2.7) is really the change of macroscopic quantum entropy under the 
unitary evolution. The left-hand side of (2.7) is a relative entropy, hence is 
non- negative. 



3 Perturbations by measurement 



In contrast with the classical evolution, the unitary evolution can be non- 
trivially interrupted by measurements that reduce the state. We follow here 
the theory of von Neumann (or, convential quantum mechanics) that adds a 
dynamic interpretation to the projections (1.10). We extend here the results 
of the previous section to include interactions with a measurement apparatus. 
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Suppose that we start the system described by a density matrix p at time 
and that we measure the macroscopic value a at time r > 0. Then, the new 
density matrix is 

P a U P U*P a 
Tr[P a UpU*\ 

where U = U(t) — exp[— itH\. This reduction takes place with probability 

p(UpU*)(a) = Tr[P a UpU*] 
We can generalize this to a sequence of measurements. 

3.1 Path-space measure 

We consider a sequence of times 0,r, 2r, . . . ,nr = t (evenly spaced for con- 
venience). A macroscopic trajectory uj assigns to each of these times a value 
for the macroscopic observables. In short, cu = (cu , . . . , u n ) with each Ui being 
equal to some projection P a on the linear subspace H a of (1.5). We consider 
the operator 

G u = u n Uu n - X . . .lu-JJluq (3.1) 
and, for a given density matrix p on TC, the matrix 

P>,a/)= Tr[G uP G*J (3.2) 

This resembles the correlation matrix that is used in the definition of quantum 
dynamical entropy, see p. 189 in [2], but again, here our partitioning corre- 
sponds to macrostates. 

It is easy to verify that V p is non-negative and has trace one. We call it the 
path-space density matrix. 

T> p depends on the initial density matrix p and it also gives the probability 
to find the system after time t = nr of (measurement-)free evolution in the 
macrostate a: 

Y, V p (u,J)= Tr[P aPt ] (3.3) 

u>,u>':ui n =ijj' n =Pa 

where p t = U n pU~ n . 

More importantly, the probability to measure the trajectory u, i.e., to see the 
system at the initial time in the macrostate represented by c^o, at time r in 
macrostate ui, and so on till time nr = t, is given by the diagonal element 

Prob p [cj] = V p {u,uj) (3.4) 

Its marginal at time t = nr, 

p t (a)= Y, Prob>] (3.5) 

uj:uj n =P a 
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is the probability of macrostate a when the unitary evolution was interrupted 
by n measurements. It equals (2.3) in case n — 1. 

3.2 Time-reversal 

On trajectories, the time-reversal transformation 6 is 

(Qu) m = TT^n-mVT, 771 = 0,1,..., 71 

Since the microscopic dynamics is time-reversal invariant, we immediately 
deduce that 

and it is easy to verify that for p = id/d in (3.2) 

V{Quj',Quj) =V(u,J) (3.6) 

In particular, for (3.4) with p = id/d, Prob[cj] = Prob[Oo;]. This identity 
has two related interpretations. First, it is the expression of (quantum) de- 
tailed balance or microscopic reversibility for the trajectories sampled from 
the time-invariant density matrix id/d corresponding to equilibrium. It is the 
generalization of (2.5). Secondly, it generalizes the observation of [1] that mea- 
surements do not introduce a time-asymmetric element (or, the reduction of 
the wave packet does not lead to irreversibility). 

Yet, in general, the system could start in a nonequilibrium state and evolve 
towards equilibrium. This involves a change of entropy; that is, for closed and 
thermally isolated systems, its total entropy production. 
The time-reversal of the density matrix V p , written V P Q, is defined as 

V p Q(uj, u') = V p {Quj', Quj) (3.7) 

so that by (3.6), T>Q = T>. This last equality is broken for a general T> p and it 
seems natural to estimate this breaking via the relative entropy 

S(V Pl \V P2 Q) = Tr[D pi (\ogV pi - log 2^9)] (3.8) 

In view of the classical results of [4,5], it is to be expected that this relative 
entropy is related to the entropy production for the appropriate choices of pi 
(as initial state) and of p 2 (as time-reversal of the final state). 

3. 3 Entropy production 

We start again from fi as initial probability distribution (i.e., p{fi) is the initial 
density matrix) and the final probability distribution fi t is defined in (3.5). The 
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main result is now readily obtained starting with the analogue of (2.4): the 
logarithmic ratio of probabilities (3.4) of a macroscopic trajectory, one started 
from \x and the other started from /2 t 7r, is abbreviated as 

This object will not always be well-defined for all uj. We can suppose however 
that the /2(a) ^ ^ /it (a) so that a little calculation of (3.9) yields 

Rfxiu) = \ogd(u n ) - log d(u ) - log fa {u n ) + log jl(u ) (3.10) 

In the notation of (1.6), the first difference in the right-hand side of (3.10) 
equals the change of Boltzmann entropy Ssicxt) — Sb(&o) for a trajectory that 
starts in macrostate a and ends in macrostate a t . If the system is initially 
prepared in essentially one macrostate, ft(a ) ~ 1, and if the evolution on the 
level of macrostates is quasi-autonomous till time t in the sense that (it(a t ) — 
1, then only that change in Boltzmann entropies survives. 
Taking the expectation of (3.9), we get, similar as in (2.7), 

^Prob A [cj] Rjx(uS) = S(fa) - S(fi) > (3.11) 

equal to the change of quantum entropy (1.11)— (1.12). The non-negativity fol- 
lows from Jensen's inequality applied to the left-hand side of (3.11). 
One can easily check that this expectation (the left-hand side of (3.11)) and 
hence, the change of quantum entropy (the right-hand side of (3.11)), also 
coincides with the relative entropy on the level of density matrices for trajec- 
tories 

SiV^V^Q) = Tr [P A (log^ - logP At7r e)] 
as announced in (3.8). 



4 Conclusions and additional remarks 



Entropy production, also for the quantum situation, has been under intense 
investigation in recent years. A list of related references, even restricted to the 
last 5 years would soon fill an extra couple of pages. In the classical case, there 
have been essentially two types of approaches, dynamical versus statistical. In 
the dynamical approach, entropy production is connected with the fractal or 
singular nature of a class of natural stationary measures. A key-notion is the 
phase space contraction rate and with some extrapolations, nonequilibrium 
statistical mechanics becomes a branch of the theory of smooth dynamical 
systems. It was partially motivated by numerical work and it has given won- 
derful insights, guiding towards a study of fluctuations of the entropy pro- 
duction, possibly generalizing close to equilibrium relations. The statistical 
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approach emphasizes the sharp contrast between the microscopic and macro- 
scopic scales and stochasticity enters the dynamical evolutions because of the 
reduced description. On space-time the histories have a distribution that share 
the essential properties of Gibbs measures. The entropy production can then 
be identified with the source term of time-reversal breaking in the action (or 
space-time Lagrangian) of the space-time distribution; the Gibbs formalism 
reproduces and extends the results for the fluctuations of the entropy pro- 
duction obtained in the purely dynamical approach. The projections on equal 
time surfaces reproduce the time-evolved measure. In the quantum case, the 
modern dynamical approach does not seem to have a natural generalization. 
Instead, the old machinery of operator-algebra and spectral theory, directly 
applied on infinite volume systems, has been providing encouraging results for 
relaxation to equilibrium and the positivity of entropy production in driven 
quantum systems. Again however, the conceptual framework and the essential 
distinction between microstates and macro-statistics is, at least to our taste, 
most often blurred in non-intuitive dynamical assumptions and in the heavy 
mathematical formalism. The present paper offers an alternative and starts 
the statistical approach for quantum systems. The first step indeed is to be 
quite clear as to the relation between time-reversal and entropy production. 
As in the classical case, we consider this important for constructing nonequi- 
librium statistical mechanics. Specifically, we hope that the characterizations 
of (2.6) and (3.10) will prove useful for deriving general fluctuation and re- 
sponse identities going beyond close to equilibrium. 
We add some general remarks. 

1. For reversible systems the entropy production is a state function. It does 
not depend on the actual path but can be written as a difference of the same 
quantity evaluated at the initial and the final time, see (2.6) or (3.10). This 
can be different for driven or irreversible systems. A similar treatment for 
such systems in the classical regime can be found in [5]. One of the main 
consequences of the identities that correspond there to (2.6) or (3.10) is that 
certain symmetries in the fluctuations of the entropy production rate are easily 
established. The quantum case is in preparation. 

2. Nothing of the previous mathematical identities depends on the assumption 
that the system is large, of macroscopic size, containing a huge number of par- 
ticles. Of course, to meaningfully discuss macroscopic variables or macrostates 
and their trajectories one has in mind a clear separation between micro and 
macro scales but the results of Sections 2 and 3 are true without. Yet again, 
their interpretation as thermodynamic entropy production and the relation 
with the second law can only be made when dealing with macroscopic sys- 
tems. See also Appendix A in [5] for these considerations in the classical case. 

3. The use of the projections P a in the construction of the path-space density 
matrix of Section 3 refers to the so called von Neumann measurements. One 
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can imagine more fuzzy measurements (and more rounded-off macrostates) 
and a corresponding decomposition of unity as 

J2Kx a = id 

a 

The treatment above was restricted to the case X a = P a U . This extension 
is very much related to the dynamics of open systems, see e.g. [2]. The in- 
volvement of measurements interrupting the unitary evolution already points 
to the interaction with the outside world. The question of isolation, even as 
an idealization, of a quantum system is much more subtle than for a classical 
system. 
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